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BACKGROUND OF THE INVENTION 

Field of Invention 

The present invention pertains to the field of 
5 computer systems. More particularly, this invention 
relates to flexible allocation of a resource in a 
computer system. 

Art Background 

10 A computer system typically includes resources 

that are shared among multiple users. An example of 
a shared resource is a shared physical memory. 
Examples of a shared physical memory include main 
memory, persistent memory including mass storage 

15 devices, and information stores, etc. Another 

example of a shared resource is a communication link. 
Yet another example of a shared resource is a 
processor. 

20 A shared resource usually has a limited capacity 

or limited capability with respect to the needs of 
the potential users of the shared resource. For 
example, a physical memory usually has a limited 
storage capacity. A communication link typically has 

25 a limited bandwidth. A processor usually has a 
limited instruction execution throughput. As a 
consequence, computer systems commonly implement 
methods for allocating the capacity or capability of 
a shared resource among the users of the shared 

30 resource. 

One prior method for allocating a shared 
resource is to employ static partitioning. For 
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example, static partitioning may be applied to a 
physical memory having a storage capacity of C bytes 
by allocating C/n bytes to each of n potential users 
of the physical memory. Unfortunately, such static 
5 partitioning usually limits each user to C/n bytes 

even when a only a small percentage of the potential 
users actually use physical memory at any given time. 
Such partitioning commonly results in severe 
underutilization of the shared resource. 

10 

Another prior method for allocating a shared 
resource is to allocate a portion of the shared 
resource to each requesting user on a first-come- 
first-served basis. For a physical memory having a 

15 storage capacity of C bytes, for example, C/10 bytes 
may be allocated to each requesting user. 
Unfortunately, such a method usually exhausts the 
capacity of the shared resource after the first 10 
users, thereby locking subsequent users out of the 

20 shared resource. 
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SUMMARY OF THE INVENTION 



A method is disclosed for flexible allocation of 
a resource. The method involves assigning a soft 
5 limit and a hard limit to each of a set of potential 
users of the resource. The soft limits are selected 
to guarantee access to the resource by all of the 
potential users. The hard limits are selected to 
enable each potential user to exceed the 

10 corresponding soft limit on a first-come-first-served 
basis. A request from a user for allocation of a 
portion of the resource is handled by granting the 
request if the request if allowed would not exceed 
soft limit assigned to the user. The request is 

15 denied if the request if allowed would exceed the 

hard limit assigned to the user. To avoid overtaxing 
the capacity of the resource, the request is denied 
even when the hard limit of the user is not exceeded 
if the request if allowed would cause a total 

20 allocation of the resource to exceed a high watermark 
assigned to the resource. 



Other features and advantages of the present 
invention will be apparent from the detailed 
25 description that follows. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention is described with respect 
to particular exemplary embodiments thereof and 
5 reference is accordingly made to the drawings in 
which : 

Figure 1 shows a computer system that 
incorporates the present teachings; 

10 

Figure 2 illustrates the handling of a request 
for allocation of a resource by a resource manager in 
a normal mode in one embodiment; 

15 Figure 3 illustrates the handling of a request 

for allocation of the resource by the resource 
manager in a reduction mode in one embodiment. 
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DETAILED DESCRIPTION 

Figure 1 shows a computer system 100 that 
incorporates the present teachings. The computer 
5 system 100 includes a resource 10 that is shared 

among a set of tasks 20-30. Portions of the resource 
10 are allocated to the tasks 20-30 by a resource 
manager 12. The resource manager 12 maintains a set 
of resource allocation parameters 14 which are used 
10 in resource allocation. 

The resource 10 represents any resource having a 
limited capacity or capability that may be allocated 
among the tasks 20-30. The resource 10 may be a 

15 hardware resource, a software resource, or a 

combination hardware/software resource. Examples for 
the resource 10 include physical memory such as main 
memory, mass storage, persistent stores, information 
stores including databases, non-volatile memory, 

20 processor time, communication links, and input/output 
devices to name a few examples. 

The tasks 20-30 represent software tasks that 
may be executed on the computer system 100. Examples 

25 for the tasks 20-30 include application programs and 
related software components and user interface tasks. 
Each task 20-30 may be associated with a particular 
user of the computer system 10. More than one of the 
tasks 20-30 may be associated with the same user. In 

30 one embodiment, the resource manager 12 allocates the 
resource 10 on a per user basis so that all of the 
tasks associated with a given user are confined to a 
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portion of the resource 10 that is allocated to the 
given user by the resource manager 12. 



The computer system 100 may be a single 
5 processor system, a multiple processor system, 
multiple networked computer systems, multiple 
networked devices which include computing 
capabilities, or any combination of these. The 
resource manager 12 may be part of an operating 
10 system of the computer system 100, may be a component 
such as a device driver, and/or may function as a 
server for the resource 10 that handles requests from 
the tasks 20-30 which function as clients. 

15 The capacity or capability of the resource 10 

may be expressed in terms of units. For example, if 
the resource 10 is a memory then a unit may be a 
byte, a block, a line, a kilobyte, a megabyte, etc. 
In another example, if the resource 10 is a 

20 communication link then a unit may be a bit per 

second, a kilobit per second, or a megabit per second 
of communication bandwidth, etc. In yet another 
example, if the resource 10 is a processor then a 
unit may be a million instructions per second (MIPS) 

25 of processor execution time. 

The resource manager 12 receives requests from 
the tasks 20-30 for allocation of the resource 10. 
The resource manager 120 allocates portions of the 
30 resource 10 to the requesting tasks 20-30 using 
information provided by the resource allocation 
parameters 14. 
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The resource allocation parameters 14 include a 
total capacity or capability (T) of the resource 10 
expressed in units. The value of T depends on the 
characteristics of the resource 10 and the selected 
5 units. For example, if the resource 10 is a 1000 

megabyte memory then T equals 1000 if the units are 
megabytes . 

The value of T may also take into account a 
10 portion of the resource 10 which is allocated to 

system functions and not available to the tasks 20- 
30. For example, if the resource 10 is a 1000 
megabyte memory, then 50 megabytes may be reserved 
for system use and unavailable for allocation to the 
15 tasks 20-30. This yields a value of T of 950 units 
in megabytes. 

The resource allocation parameters 14 include a 
soft limit (S) which applies to each potential user 
20 of the resource 10. The soft limit S is a minimum 
portion of the resource 10 to which each potential 
user has guaranteed access, thereby preventing 
potential users from being locked out of the resource 
10 at any time. 

25 

The soft limit S is a tunable parameter of the 
computer system 100. It is preferable that S be set 
to a high enough value as to enable advantageous use 
of the resource 10 but not so high as to needlessly 
30 tie up the capacity of the resource 10 when only a 
few of the potential users access the resource 10. 
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The soft limit S may be the same for all 
potential users or may be set on a per user basis or 
on the basis of classes of users. For example, some 
classes of users such as those who pay more or those 
5 in management positions, etc., may have a higher soft 
limit than that of ordinary users. 

The resource allocation parameters 14 include a 
hard limit (H) which enables users to exceed their 

10 soft limits under predetermined conditions. A given 
user is always granted his soft limit and may be 
granted up to his hard limit if the current 
utilization of the resource 10 can accommodate the 
request. The maximum value for the hard limit H is 

15 equal to T minus the sum of the soft limits of all 
potential users. The hard limit H is a tunable 
parameter of the computer system 100. The hard limit 
H may be the same for all potential users or may be 
set on a per user basis or on the basis of classes of 

20 users. 

The resource allocation parameters 14 include a 
high watermark and a low watermark. The high 
watermark is an upper limit on the total utilization 

25 of the resource 10. The difference between the high 
and low watermarks provides hysteresis that prevents 
thrashing that would otherwise occur when one of the 
tasks 20-30 frees a portion of the resource 10 and 
then reallocates that portion when the resource 10 is 

30 near its capacity. 

Figure 2 illustrates the handling of a request 
200 for allocation of the resource 10 by the resource 



Attorney Docket No. 10992795 



- 9 - 

manager 12 in a normal mode in one embodiment. The 
normal mode of handling a request for allocation is 
the initial mode before the high watermark of the 
resource 10 has been exceeded. 

5 

In this example, the request 200 is generated by 
the task 20 and specifies a requested portion of the 
resource 10 expressed as nl units. The request 200 
may be an initial request for nl units of the 
10 resource 10 or a subsequent request for additional 
allocation of nl units of the resource 10. 

At step 100, the resource manager 12 determines 
the total allocation of the resource 10 to the user 

15 associated with the task 20 that would result if the 
request 200 is granted. The resource manager 12 
records allocations of the resource 10 to users on a 
per user basis. For example, assume that the task 20 
corresponds to user A and that the tasks 21-22 also 

20 correspond to user A and have previously been granted 
n2, and n3 units of the resource 10, respectively. 
If so, the total allocation for the user A determined 
at step 100 is equal to n2+n3+nl. If tasks 
corresponding to the user A have not previously been 

25 granted any units of the resource 10 then the total 
allocation for the user A determined at step 100 is 
equal to nl . 

At step 102, the resource manager 12 determines 
30 whether the total allocation obtained at step 100 

exceeds the soft limit for the user associated with 
the task 20. If the total allocation obtained at 
step 100, which includes the request 200 for nl 
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units, would not exceed the user's soft limit then 
the request 200 is granted at step 104. Otherwise, 
the user's hard limit is tested at step 106. 

5 At step 106, the resource manager 12 determines 

whether the total allocation obtained at step 100 
exceeds the hard limit for the user associated with 
the task 20. If the total allocation obtained at 
step 100, which includes the new request 200 for nl 
10 units, would exceed the user's hard limit then the 
request 200 is denied at step 108. Otherwise, the 
high watermark is tested at step 110. 

At step 110, the resource manager 12 determines 
15 whether the total allocation obtained at step 100 
would cause the grand total allocation of the 
resource 10 to all users to exceed the high watermark 
of the resource 10. If the granting of the request 
200 would not cause the grand total allocation to 
20 exceed the high watermark then the request 200 is 
granted at step 114. 

If the granting of the request 200 would cause 
the grand total allocation of the resource 10 to 

25 exceed the high watermark then at step 112 the 

request 200 is denied. In addition, at step 116 the 
resource manager 12 enters a reduction mode for 
handling requests. In the reduction mode, the 
resource manager 12 always allows requests the reduce 

30 the consumption of the resource 10. 

Figure 3 illustrates the handling of a request 
220 for allocation of the resource 10 by the resource 
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manager 12 in the reduction mode in one embodiment. 
The reduction mode of handling a request for 
allocation provides hysteresis that prevents 
thrashing that would otherwise occur when one of the 
5 tasks 20-30 frees a portion of the resource 10 and 

then reallocates that portion when the resource 10 is 
near its capacity. 

In this example, the request 220 is generated by 
10 the task 30 and specifies a requested portion of the 
resource 10 expressed as nlO units. The request 200 
may be an initial request for the resource 10 by a 
user associated with the task 30 or a subsequent 
request for additional allocation of nlO units of the 
15 resource 10. 

At step 130, the resource manager 12 determines 
the total allocation of the resource 10 to the user 
associated with the task 30 that would result if the 
20 request 220 is granted. 

At step 132, the resource manager 12 determines 
whether the total allocation obtained at step 130 
exceeds the soft limit for the user associated with 
25 the task 30. If the total allocation obtained at 
step 130, which includes the request 220 for nlO 
units, would not exceed the user's soft limit then 
the request 220 is granted at step 134. Otherwise, 
the hard limit is tested at step 136. 

30 

At step 136, the resource manager 12 determines 
whether the total allocation obtained at step 130 
exceeds the hard limit for the user associated with 
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the task 30. If the total allocation obtained at 
step 130, which includes the request 220 for nlO 
units, would exceed the user's hard limit then the 
request 220 is denied at step 138. Otherwise, the 
5 low watermark is tested at step 140. 

At step 140, the resource manager 12 determines 
whether the total allocation of the resource 10 is 
below its low watermark. If the total allocation is 
10 not below the low watermark then the request 220 is 
denied at step 146. 

If the total allocation is below the low 
watermark then the request 220 is granted at step 
15 142. In addition, at step 144 the resource manager 
12 returns to the normal mode for handling requests. 



The foregoing detailed description of the 
present invention is provided for the purposes of 
20 illustration and is not intended to be exhaustive or 
to limit the invention to the precise embodiment 
disclosed. Accordingly, the scope of the present 
invention is defined by the appended claims. 
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CLAIMS 

What is claimed is: 

5 1. A method for flexible allocation of a resource, 
comprising the steps of: 

obtaining a request for allocation of a portion 
of the resource; 

granting the request if the request if allowed 
10 would not exceed a soft limit associated with a 

potential user associated with the request, wherein 
the soft limit guarantees access to the resource by 
the potential user; 

denying the request if the request if allowed 
15 would exceed a hard limit associated with the 

potential user, wherein the hard limit enables the 
potential user to exceed the soft limit on a first- 
come-first-served basis; 

denying the request if the request if allowed 
20 would cause a grand total allocation of the resource 
to exceed a high watermark assigned to the resource 
and granting the request otherwise. 

2. The method of claim 1, wherein the step of 

25 denying the request if the request if allowed would 
cause a grand total allocation of the resource to 
exceed a high watermark further comprises the step of 
entering a reduction mode for handling a subsequent 
request for allocation of the resource. 

30 

3. The method of claim 2, wherein the reduction 
mode comprises the step of: 
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granting the subsequent request if the 
subsequent request if allowed would not exceed a soft 
limit associated with a potential user associated 
with the subsequent request; 
5 denying the subsequent request if the subsequent 

request if allowed would exceed a hard limit 
associated with the potential user associated with 
the subsequent request; 

denying the subsequent request if the grand 
10 total allocation of the resource is above a low 

watermark associated with the resource and granting 
the subsequent request otherwise. 

4. The method of claim 3, further comprising the 
15 step of assigning the low watermark to the resource. 

5. The method of claim 1, further comprising the 
step of assigning the soft limit to the potential 
user . 

20 

6. The method of claim 5, wherein the step of 
assigning the soft limit comprises the step of 
assigning the soft limit in response to a class 
associated with the potential user. 

25 

7. The method of claim 1, further comprising the 
step of assigning the hard limit to the potential 
user . 

30 8. The method of claim 7, wherein the step of 
assigning the hard limit comprises the step of 
assigning the hard limit in response to a class 
associated with the potential user. 
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9. The method of claim 1, further comprising the 
step of assigning the high watermark to the resource. 



10. The method of claim 1, further comprising the 
5 step of allocating a portion of the resource for 

system use. 

11. A computer system, comprising: 
resource; 

10 a set of resource allocation parameters for the 

resource including a high watermark for the resource 
and a hard limit and a soft limit associated with a 
potential user of the resource; 

task that generates a request for allocation of 

15 a portion of the resource; 

resource manager that in a normal mode grants 
the request if the request if allowed would not 
exceed the soft limit and denies the request if the 
request if allowed would exceed the hard limit and 

20 denies the request if the request if allowed would 
cause a grand total allocation of the resource to 
exceed the high watermark and grants the request 
otherwise . 

25 12. The computer system of claim 11, wherein the 

resource manager switches to a reduction mode if the 
request if allowed would cause the grand total 
allocation to exceed the high watermark such that the 
resource manager grants all subsequent requests that 

30 reduce a consumption of the resource while in the 
reduction mode. 
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13. The computer system of claim 11, wherein the 
soft limit is assigned to the potential user to 
guarantee access to the resource by the potential 
user . 

5 

14. The computer system of claim 11, wherein the 
hard limit is assigned to the potential user to 
enable the potential user to exceed the soft limit on 
a first-come-first-served basis. 

10 

15. The computer system of claim 11, wherein the 
resource manager enters a reduction mode for handling 
a subsequent request for allocation of the resource 
if the request if allowed would exceed the high 

15 watermark. 

16. The computer system of claim 15, wherein the 
resource manager in the reduction mode grants the 
subsequent request if the subsequent request if 

20 allowed would not exceed a soft limit associated with 
a potential user associated with the subsequent 
request and denies the subsequent request if the 
subsequent request if allowed would exceed a hard 
limit associated with the potential user associated 

25 with the subsequent request and denies the subsequent 
request if the grand total allocation of the resource 
is above a low watermark associated with the resource 
and grants the subsequent request the grand total 
allocation is below the low watermark. 

30 

17. The computer system of claim 16, wherein the 
resource manager switches to the normal mode if the 
grand total allocation is below the low watermark. 
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ABSTRACT 

A method for flexible allocation of a resource 
in which a soft limit and a hard limit are assigned 
to each of a set of potential users of the resource. 
5 The soft limits are selected to guarantee access to 

the resource by all of the potential users. The hard 
limits are selected to enable each potential user to 
exceed the corresponding soft limit on a first-come- 
first-served basis. A request from a user for 

10 allocation of a portion of the resource is handled by 
granting the request if the request if allowed would 
not exceed soft limit assigned to the user. The 
request is denied if the request if allowed would 
exceed the hard limit assigned to the user. To avoid 

15 overtaxing the capacity of the resource, the request 
is denied even when the hard limit of the user is not 
exceeded if the request if allowed would cause a 
total allocation of the resource to exceed a high 
watermark assigned to the resource. 
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